Multiscaling and information content of natural color images 
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Naive scale invariance is not a true property of natural 
images. Natural monochrome images posses a much richer 
geometrical structure, that is particularly well described in 
terms of multiscaling relations. This means that the pixels 
of a given image can be decomposed into sets, the fractal 
components of the image, with well-defined scaling exponents 
(Turiel & Parga, submitted) . Here it is shown that multispec- 
tral representations of natural scenes also exhibit multiscaling 
properties, observing the same kind of behavior. A precise 
measure of the informational relevance of the fractal compo- 
nents is also given, and it is shown that there are important 
differences between the intrinsically redundant RGB system 
and the decorrelated one defined in (Ruderman, Cronin & 
Chiao, 1998). 
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I. INTRODUCTION 



The description of the early stages of the visual path- 
way in mammalians and other animals must be addressed 
from the knowledge of the properties of the signal that 
this system is intended to encode: natural images [0-||. 
These are very complex objects, and truly random from 
the point of view of the observer. However, natural im- 
ages are structured, highly redundant objects, a fact that 
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becomes clear for instance in that the luminosity changes 
smoothly over the reflecting surfaces. This redundancy, 
which should be used as a priori knowledge about the sig- 
nal, is useful to develop optimal coding strategies, which 
are learnt by the sensory system. It is then a crucial task 
to describe the redundancy. In the study of multispec- 
tral images we are faced with two kinds of redundancy: 
chromatic and geometrical. 

The information conveyed by multispectral images is 
obviously very redundant, particularly for those spectral 
channels with the closest wavelengths. Each channel be- 
haves statistically much like a single monochrome chan- 
nel, with similar geometrical redundancies and strong 
mutual dependencies. Taking as starting point the usual 
three-channel RGB representation (that we will hereafter 
call the chromatic system RGB) according to the hu- 
man sensory receptor classes, Ruderman et al B devel- 
oped a chromatic system of three new variables (called 
laP). As defined, this chromatic system decorrelates the 
three signals at each point in the image. Thus, these 
signals define a more compact codification of the RGB 
images. Moreover, the variables these authors obtain are 
reminiscent of the chronratic channels of human color vi- 
sion. 

With respect to geometrical redundancy, it is a well 
known fact that natural images possess power law scal- 
ings which reflect their scale invariant nature. The best 
known of these scaling properties is the one associated 
with the power spectrum (see MM for instance), which 
is usually related to the fractal character of images. Re- 
cently, a hierarchical class of scaling laws has been ob- 
served in monochrome natural images: those forming 
the so called Self-Similarity (SS) and Extended Self- 
Similarity (ESS) properties (see ||]). This more detailed 
structure reveals that images are not simple fractals, but 
multifractal objects which can be split into different frac- 
tal sets that transform differently under changes in scale. 
The hierarchical structure of the fractal components has 



been even proposed as a natural way of classifying the 
information content of the visual scenes ||l^ . 

The aim of this work is to explain the chromatic sys- 
tems both from the geometrical meaning of the fractal 
components of color images and from the evaluation of 
the information conveyed by each chromatic channel over 
the fractal components. We will present the following: 

1. Verification of the scaling laws (SS and ESS) in 
the chromatic sytems (that is, the standard Red- 
Green-Blue (RGB) and the decorrelating one {laj3) 

§■ 

2. Performance of a multifractal decomposition of im- 
ages for the two chromatic sytems and a classifi- 
cation of the resulting fractal components, empha- 
sizing the importance and the interpretation of the 
most relevant of them, the Most Singular Manifold 
(MSM). 

3. Determination of the information content and the 
mutual informations among the three components 
of a given chromatic system, for different sets of 
pixels (whole image, MSM and second MSM). 

The paper is structured as follows: In Section || the 
instrumental and processing methods used in the elab- 
oration of this work are summarized. The concepts of 
anomalous scaling laws (SS and ESS) and their experi- 
mental validations are given in Section pT[| Section IV 
explains the Log-Poisson model which is used to describe 
the anomalous exponents. In Section |V| our statistical 
results are interpreted in geometrical terms, and the de- 
composition of the images into their fractal components 
is shown. In addition, the differences between the two 
chromatic systems are also observed and explained. In 
Section VI a precise measure of the information content 
and mutual informations of the variables are given and 
interpreted. Finally, the main conclusions are presented 



in Section VI] 



II. METHODS 



The data gathering methods were as in [g. Briefly, 
spectral images were captured using an Electrim EDC- 
lOOOTE camera with a resolution of 192 x 165 (horizontal 
X vertical) 8-bit pixels. Light reaching the CCD array 
was passed through a variable interference filter with a 
wavelength range of 400 to 740 nm of bandpass typi- 
cally 15 nm. In each image, 43 successive images were 
taken of each scene at 7-8 nm intervals from 403 to 719 
nm. Each pixel subtended a rectangle of 0.047 x 0.055 
degrees (horizontal x vertical). No corrections for op- 
tical or CCD-element spatial filtering were made; how- 
ever the estimated dark noise was subtracted from each 
GGD image on a pixel-by-pixel basis. In attempting 
to select a diversity of typical foliage-dominated scenes, 



images were collected in several locations around Bal- 
timore, Maryland (temperate woodland) and Brisbane, 
Australia (sclerophyll forest, subtropical rainforest, and 
mangrove swamp). Selected scenes contained numerous 
natural objects, including leaf foliage, bark, rocks, herbs, 
streams, bare soil, etc. In one corner of each imaged 
scene small refiectance standards were placed for cali- 
bration purposes: a Spectralon 100% diffuse refiectance 
material (Labsphere) and a nominally 3% spectrally flat 
diffuse reflector (MacBeth). 

We collected images of 12 such natural scenes, and fur- 
ther analyzed the central 128 x 128 pixel region. Each 
of the (128 X 128 x 12 = 196608) pixels was converted 
to three theoretical cone responses as J2x QWRWH^)j 
where Q{X)js the Stockman-MacLeod- Johnson cone fun- 
damental [nl| for the given cone type, i?(A) is the mea- 
sured image refiectance data, /(A) is the standard illu- 
minant D65 (which is meant to mimic a daylight spec- 
trum |ll| , |l2|] ), and the sum is over wavelengths repre- 
sented in the spectrum. Our results depend only very 
weakly on the choice of illuminant, so long as it is broad- 
band. This procedure provides the cone response data 
L{x), M{x), and S{x), proportional to the number of 
quanta absorbed in an L, M, or S cone at spatial lo- 
cation X within the image. The raw reflectance data 
for the 12 i mages are available via anonymous ft p at 



ftp://sloan.salk.edu/pub/ruderman/hyperspectral/. 

We will make use of two different chromatic systems 
of cone response variables to represent each image, the 
RGB system and the la(3 system. The RGB system is 
formed by the raw L (Blue), M (Green) and S (Red) 
responses and is intended to be an unprocessed represen- 
tation of the image. The laP system is formed by the 
variables obtained in [|6|, which is defined as follows: 



I = -i=i\ogL -t- logAf + log 5) - h 
v3 

a = —={\ogL -I- log M - 2 logs') - ao 
/3=-i=(logL - logM) - /3o 



(1) 



where Zq, ao and /3o are appropriate constants verify- 
ing that the average of each variable over each image is 
equal to zero. These variables are decorrelated, that is, 
the average of the product of any two different variables 
vanishes (see |^. This decorrelation property is a weak 
kind of independence (if the variables are independent 
then they are decorrelated). 



III. STATISTICS OF IMAGES: MULTISCALING 

It is believed that natural images behave like " fractal" 
objects: they do not possess a scale of reference and they 
are self-similar |7| , each small portion of them behaving in 
the same as the whole image (in a statistical sense). How- 
ever the kind of self-similar behavior shown by the power 



spectrum is insufRcient to provide a detailed description 
of the local structure of natural scenes. ll^jlj,y,|l^ This 
is because it assigns the same scaling exponent to every 
image pixel. To obtain a better description of the image, 
it is necessary to define a variable with a local scope, able 
to detect its local features. The hope is that a variable 
like this could assign distinct self-similar behaviors to dif- 
ferent pixels, which in turn could be used to detect and 
classify its local features. Examples of this approach can 
be found in [pUlCfl, where dealing with grayscale images 
a whole hierarchy of image fetures, from sharp edges to 
textures, has been put in correspondence with local scal- 
ing exponents. 

In this work the approach is extended to color images. 
The existence of a hierarchy is explored and explicitly 
checked for all the components of the chromatic systems 
presented in the previous section. In analogy with the 
variables defined in lyJlQl, given any of the chromatic 
components presented in Section ||, the Edge Content 
(EC) of this component at the point x and at the scale 
r, er{x), is defined as: 



e^(f) ^ \ [ dx' |VC|(f' 



(2) 



where C{x) denotes the selected chromatic component 
(e.g., R, G, B, I, a or /3). The bi-dimensional integral is 
defined over Bj.{x), which represents a square of linear 
size r centered at x. We will often use one-dimensional 
surrogates of the EC, which are statistically less demand- 
ing. These are defined as integrals along a direction given 
by a vector r of length r: 



ep{x) 



1 r/j dc 



r 



(3) 



As noted before, these variables compute the average 
over a scale r of a quantity that compares two neigh- 
boring points. It is then clear that even its marginal 
distribution contains information about the local struc- 
ture of the image. This is not the case for the more usual 
average over the same scale of the chromatic components 
themselves. 

We now introduce the important concepts of Self Sim- 
ilarity (SS) and Extended Self Similarity (ESS). 
Given a random variable e^ defined on a local area of 
size r, we would say that this variable has SS if its statis- 
tical moments of order p obey a power law with exponent 



i^'r) 



(4) 



where ap is a geometrical factor. Since Tp is an arbitrary 
function of p, this is a more general type of scaling than 
the one observed in the power spectrum. The knowledge 
of an infinite collection of exponents will provide a useful 
description of the system. The simplest possible system 
exhibiting SS is that in which Tp oc p. In that case, the 



dependence on the scale parameter r is trivial: it sim- 
ply implies that the moments of the normalized variable 
trl {cr) do not depend on r. The most interesting cases 
are those in which Tp ^ ti p, and this deviation is known 
as anomalous scaling. 

The concept of ESS requires that the moments verify 
a weaker identity: 



{el) ^ A{p,2) {elY^^^^^ 



(5) 



Notice that any moment of order q could be used in the 
place of the second order one (provided p{q,2) ^ 0). If 
tr has SS it also has ESS, and the relation between the 
exponents Tp and p(j)^ 2) is: 



T2 



(6) 



We can now vcrifyif SS and ESS hold for the dataset 
presented in Section ^\. For this purpose we have used the 
variables ef(x) (eq. (0)) taking r in both the horizontal 
and the vertical directions. The numerical analysis was 
done over the six EC variables built on the six chromatic 
components RGB and Za/3. The scale r was taken small 
compared with the total size of the image (r < 64 pixels) 
and p was taken up to p = 10. It was observed that both 
SS and ESS hold. The test for ESS is presented for the 
horizontal EC of the chromatic components RGB in fig. 
Il| and for the chromatic components /a/3 in fig. 0. 

The ESS exponents p(p, 2) are shown in fig. H^, again 
for the three components of the two chromatic systems. 



IV. MULTIPLICATIVE PROCESSES: 
LOG-POISSON MODEL 

The data presented in the previous section show that 
ESS holds for the six chromatic components discussed in 
this work. We show here that a very simple model, based 
on a Log-Poisson multiplicative process ||l5|-p^,p[ , is 
able to fit this data. The existence of such a process 
means that the EC at a scale r is obtained from the 
EC at a greater scale L by multiplying it by a random 
variable arV- 



a.rL cl 



(7) 



where Utl is independent of e^ . The random factors a^L 
define the multiplicative process, and for any interme- 
diate scale r' , r < r' < L, the following relation must 
hold: 



arL 



OLtt' OLr'L 



(8) 



This implies that the process can be infinitely split into 
many intermediate stages, and it is thus said to be in- 
finitely divisible. The factor a,i, takes account of the 
consecutive transitions of the EC from a large scale in 
the image to smaller ones. Knowing the process and the 



probability distribution of the EC at the largest scale L, 
the probability distribution of the EC at any other scale 
r < L can be computed. 

Under an infinitesimal change in the scale (when the 
EC at scale r is generated from the EC at scale r + dr) 
the Log-Poisson model is a binomial distribution with 
one event infinitely less likely than the other. The most 
probable event corresponds to smooth transitions in the 
contrast (e.g., the surface of an object); whereas the in- 
finitesimally rare event indicates a sharp transition (e.g. 
an edge). More precisely, the a^i's are obtained by: 



^r.r-^dr 



1- 

/3(1 



A^ , probability: 1 - [d - DJ^^ 
-A^) , probability: [d-D^]!^ 

(9) 



where the parameters A and Dao can be expressed in 
terms of the SS exponent T2 and the modulation param- 
eter (3 by (for details see pO{): 




T2 

1-/3 



T2 



(10) 



Here d is the dimensionality of the system; d — 2 for 
our images. When a non-infinitesimal change in scale is 
considered, this formula leads to a Log-Poisson distribu- 
tion for the multiplicative process arL- The probability 
distribution of arL, Pa-rLi^), is given by: 



ParL (a) 



_ „-SrL 






H"{-)^) 

r 



(11) 



where SrL — {d — -Doo)lii— is the average number of 
modulations between the two scales. Notice that this 
distribution depends only on the ratio between the two 
scales. This model has been used previously to describe 
turbulent flows [Q and grayscale natural images P,|lO|. 
The ESS exponents p{p, 2) can be calculated from 
eq. ( prl ) . They depend only on the modulation parameter 
(3: 



Pip, 2) 



P 



1^ - ^13^ 



Besides, using eq. (^ one sees that the set of SS expo- 
nents Tp's can be computed with only two parameters 
(namely /3 and T2). 

To conclude this section let us notice that eq. ^ allows 
us to compute the distribution of arL from the distribu- 
tions of the EC's at the scales L and r, by deconvolution 
(Notice that this deconvolution problem is numerically 
ill-posed. As a consequence, the distribution of arL so 
obtained is less precise than the one inferred by fitting 



the moments of the EC). Two examples of these dis- 
tributions are shown in Figure y, together with the Log- 
Poisson distribution (eq. (11)). Notice that a Log-Poisson 
distribution becomes eventually Log-Normal. The reason 
is that the infinitely divisible character of arL , expressed 
in eq. (j^ implies that In arL is the sum of an infinite 
number of independent random variables. Provided that 
the dispersion of that sum is small compared with its 
mean, this process will get closer to normal. This is not 
seen in Fig. H because at the two considered scales the 
average number of transitions is rather small. This is 
a manifestation of the fact that natural images present 
far-from-gaussian behavior. 



V. GEOMETRY OF CHROMATIC 

COMPONENTS: THE MULTIFRACTAL 

REPRESENTATION 

The anomalous scaling laws for the moments of the 
chromatic EC's can be explained on the basis of local 
anomalous scaling exponents. We define the Edge Mea- 
sure (EM) for a given chromatic component of a square 
of side r centered around a point x, fi(Br{x)), as: 



li{Br{x)) — r^ er{x) 



(12) 



so the EC is just a comparison between the EM of a 
square and its standard area r^. The convenience of the 
definition of the EM with respect to that of the EC is 
given by the fact that the EM is additive: if for instance 
a square is split in several pieces, the EM of the square 
is the sum of the EM's of its parts. It is natural to ask 
whether the EM of a square shows a local power law 
scaling as: 



fi{Br{x)) — a{x) r' 



h{x)+2 



(13) 



where h{x) is the local scaling exponent of a chromatic 
component at the point x. It measures the strength of 
the singularity at this point. A measure verifying eq. (|l3| ) 
is said to be multifractal. The reason for this name is 
that any image with a multifractal measure can be ar- 
ranged in fractal components, Fh- For each chromatic 
component, these are the sets of points with the same 
exponent h. The fractal dimension of each set will be 
denoted as D{h) and this function is called the singu- 
larity spectrum of the multifractal. 

It is a well-known fact |l^ that D{h) is the Legendre 
transform of r^. This allows not only the computation 
of the singularity spectrum from the statistical data, but 
also the determination of the range of observed local sin- 
gularities h. In the Log-Poisson model, the whole singu- 
larity spectrum is determined by only two parameters. 
For instance, these can be chosen as j3 and T2, and so it 
reads 11,0: 



D{h) = d 



T2 


ln/3 


1- 


-In 


^h-^, 


(1-/3)2 


T2 ln/3 



(14) 



(here, d = 2). More interestingly, they can be chosen as 
A and Doo- Now the singularity spectrum reads: 

D{h) = D^ + id-D^)w{h)[l^lnw{h)] (15) 



d-Do 



a lin- 



where uj{h) = -{h + A)/[{d-Doo) In (l - 
ear funciton of h. The fractal component with smallest 
exponent, Foo, is called the Most Singular Manifold 
(MSM). It turns out that —A is the exponent charac- 
terizing the MSM (Foo = -F-a) and Doo = £'(-A)) is 
its dimension Q. For example, for a Log-Poisson model 
with l3 = 0.5 and T2 = —0.25 (which are close to the val- 
ues experimentally observed in our dataset) one obtains 
that A = 0.5, Z^oo = 1-0. 

There are several ways of computing explicitly the lo- 
cal exponents h{x) at a given pixel (which in turn gives 
the fractal components). The most convenient method, 
from the numeric al poi nt of view, is that of the wavelet 
transform (see po| , pi| , [lO| ) . It is based on the convolu- 
tion of the EM density with an appropiate function ^(x), 
the wavelet, which is resized using a scale variable r to 
focus the convenient details at each scale. We thus define 
the wavelet projection T^dfj,{x) at the point x and the 
scale r as: 



T^dfiix) = j dv\VC\{y)-^r{x-y) 



(16) 



where *r(^) = 72-^(7 )• It can be proven |2|] that the 
EM verifies the multifractal scaling, eq. (13), if and only 
if: 



T^d^jL(x) — a{x) r 



h{x) 



(17) 



where h{x) is the same exponent as in eq. (13) and a (a?) is 
a suitable function. This multircsolution method allows 
for a very good discrimination of the sets Fh ; once they 
are abtained, their irregular (fractal) nature is clear by 
simple visual inspection. 

Applying the theory to the data, using the previously 
computed values of T2 and f3 (Fig. 3) it is obtained that 
the MSM has a dimension Z?oo ~ 1, that is, it consists of 
segments of curves. Visual inspection of this set (Figures 
and 0) reveals that it is rather close to the edges present 
in the chromatic components. 

Comparison of the MSM's of the two chromatic sys- 
tems, RGB and laP, shows that they have qualitatively 
different geometrical contents. Figures |5| and |6| exemplify 
the question on a representative image. 



This fact is confirmed by the multircsolution anal- 
ysis (second row of figure ||) . 

To characterize this geometrical redundancy, we 
measured the relative density of the different 
MSM's and of their intersection across the whole 
ensemble. The values obtained are: Red MSM: 
29.95%; Green MSM: 29.89%; Blue MSM: 23.75%. 
The relative density of the intersection of the three 
sets is 19.60%. This means that the intersection 
contains 65.44% of the Red MSM, 65.57% of the 
Green MSM and 82.53% of the Blue MSM, so it 
is clear that the three MSM share a significant 
amount of geometrical content. In other words: the 
luminosity edges typically co-occur in all the three 
chromatic components in this representation. 

• The laP system has significant geometrical dif- 
ferences among its chromatic variables. There are 
very well defined borders that are shared by all the 
variables; however, several geometrical structures 
are apparent only in one of the three chromatic 
components of the image. It seems that this repre- 
sentation could enhance the separation of different 
types of objects attending to their color distribu- 
tion. This result seems very appealing. We com- 
puted again the densities of the different sets (each 
MSM and the intersection of the three) across the 
whole ensemble of images. The values are the fol- 
lowing: I MSM: 40.96%; a MSM: 45.30% (3 MSM: 
44.65%. The set resulting of the intersection of the 
three has a density of 13.93%, which means that 
it contains 34.01% of the I MSM, 30.75% of the 
a MSM and 31.20% of the (3 MSM. In this sense, 
these chromatic variables posses less geometrical re- 
dundancy than those in the RGB system. This is 
explained by the fact that there are sharp edges 
which belong just to one of the spaces and not to 
the other two, in contrast with the situation of the 
RGB system. 

The inspection of these results reveals two interesting 
features: first, the MSM's associated to the la/3 system 
are denser than those of RGB system. This is mainly 
caused by the logarithmic transformation from RGB to 
laf3, which increases the contrast on average and so en- 
hances details. Second, for the la/3 system, the ratio 
between the number of pixels in the intersection and in 
each of the MSM's is less than half of the same ratio 
in the RGB system. This makes more evident the ap- 
pearance of different geometrical structures. The higher 
degree of independence in the laf3 system is rather nat- 
ural because of their construction: they are decorrelated 
variables (see 0) 



• The RGB system is highly geometrically redun- 
dant. Simple visual inspection of the gray level 
reprentations of the three chromatic variables (first 
row of figure pi) shows three very similar scenes. 



VI. INFORMATION CONTENT 



The classification of tfie points in tfie images accord- 
ing their multifractal structure has revealed significative 
differences between the RGB and the laP schemes. Al- 
though the geometrical coincidences and the separation 
of features seem very informative, it is convenient to have 
a more quantitative criterion than the rather coarse den- 
sity estimation. In particular, it would be desirable to 
characterize the amount of information conveyed by the 
MSM's and the degree of redundancy among them. This 
characterization can be done by using the concepts of 
entropy and mutual information. 

Given a random variable X with a probability distri- 
bution p (x), its entropy (or total information) Hx 
is defined as: 



H 



X 



dx p (x) logfc p (x) 



(18) 



It has no actual units, but depending on the basis b of the 
logarithm a unit name is usually given. For 6 = 2, which 
we will use, it is expressed in bits. For discrete vari- 
ables this quantity is always a finite, positive number, 
which is maximum for uniformly distributed variables. 
For continuous variables it does not even need to be de- 
fined, and can have a positive or negative value. For this 
reason, when a discretization of a continuous variable is 
considered the discretization range is very relevant. It 
can be proved (see for instance [g^) that for discretized 
variables the entropy represents an optimal bound for the 
average amount of digits to be used in the encoding of 
events described by X. 

Given two random variables, X and K, with marginal 
probability distributions p (x) and p (y) and joint prob- 
ability distribution p {x,y), we define the mutual in- 
formation between X and Y, Ixy, as: 

IxY = fdx fdyp^ (x, y) log, ^^f'f. (19) 

It is expressed in the same units as the entropy. It can 
be proved that it is always a positive quantity which only 
vanishes when p {x,y) = p {x)p (y), so in a sense it is 
a measure of the statistical independence of the variables 
X and Y. In fact, it gives the amount of information 
shared by the two variables: 



/ 



XY 



Hx - Hx\Y 



Hy - Hy\x 



(20) 



where Hx\y is the conditional entropy, defined as: 



H 



x\y = / dyp^{y)[- j dx p^^^{x\y)\ogj, p^^^{x\y)] 



(21) 



and p {x\y) = p {x,y)/p (y) is the distribution of X 
conditioned by Y . The conditional entropy is the average 
of the entropy of X for fixed values of Y. It is the part 
of the entropy of X which is independent of F: < 



Hx\Y ^ Hx and Hx\y = Hx only if X is independent of 
Y. Thus, the mutual information, according to eq. (|2(]), 
measures the amount of bits of X which can be predicted 
by the knowledge of Y and vice-versa. 

The definition of mutual information can be extended 
to more than two variables, although not in a unique 
way. We will work with the information shared by three 
variables X , Y and Z, which can be expressed as: 



'XYZ 



iXY 



^XY\Z 



(22) 



where Ixy\z is the averaged mutual information between 
X and Y for fixed values of Z (that is, it is computed 
using p {x,y\z)). The interpretation of this quantity 

is similar to that of eq. (Efl) . The last term is the amount 
of information between X and Y which is not shared by 
Z, while the difference gives the information shared by 
the three variables. Contrary to the mutual information 
of two variables (eq. (|20|)), which is always positive, Ixyz 
can be negative. This happens when fixing the value of 
Z causes the relation between X and Y to become less 
random, increasing their statistical dependence. As an 
extreme case we consider X — Y+Z , with Z independent 
of Y. Fixing Z, the quantity Ixy\z takes its maximum 
value Hy, and Ixyz = —Hy\x- On the other hand, a 
positive value of Ixyz indicates that fixing Z the other 
two variables become more independent. 
It can be proved that: 



/ 



XYZ 



LYZ 



L 



YZ\X 



LXZ 



iXZ\Y 



(23) 



that is, the difference between the two mutual informa- 
tions is independent of which variable is kept fixed. An 
explicitly symmetric expression is given by: 



Ixyz — Ixy + Ixz + Iyz — Kxyz 



(24) 



where 
Kxyz = 



dx dy dz p {x, y, z) log. 



p^ {x)p^ {y)Pz {z) 

(25) 



We now start the information analysis of the multi- 
fractal densities jVCKx) of the chromatic components, 
when the point x runs across particular geometrical sets. 
We are interested in measuring entropies and mutual in- 
formations among the three variables of each chromatic 
system, at the same pixel x, averaging over all the pixels 
of the image ensemble. 

For each chromatic system we consider three different 
geometrical sets. The first is obtained from the whole 
images; the second contains the pixels common to the 
MSM's of the three components; and the third is given 
by the pixels common to the second MSM's. The com- 
parison between these sets will give valuable knowledge 
about the distribution of information in the image. 
We obtained the following results: 



RGB system: The results are summarized in Ta- 
ble | 

It is observed that the entropic content of the MSM 
is larger than that of the whole image, while for 
the following manifold this entropic increase is not 
present: this means that the MSM is the most in- 
formative fractal component. Besides, comparing 
the entropy of the second MSM with that of the 
whole image, it is seen that they are similar (again, 
the lack of contrast in the Blue component causes 
that some of the pixels in the MSM are detected as 
belonging to the second MSM). This implies that 
sampling pixels in the second MSM gives the same 
information as sampling in the whole image (it was 
also observed that less singular fractal components 
give the same information as the whole image). 
This system exhibits a rather large amount of mu- 
tual information between pairs of variables, which 
is maximal for the pair Red-Green (those with the 
most similar wavelength ranges) for the three ge- 
ometrical sets. Related to this, one also observes 
that Igb — Irb — I BOB, that is the information 
shared by the pairs GB or RB is close to the infor- 
mation common to the three variables. This shows 
again the strong dependence between the Red and 
Green components. 

Notice that the mutual informations also follow the 
same changes shown by the entropies over the geo- 
metrical sets. 

la(3 system: Table || summarizes the results ob- 
tained for this system. 

We first notice that all the entropies are larger than 
those of the RGB components. It also exhibits 
an entropic increment of the MSM with respect to 
the whole images, although it is smaller than for 
the RGB system. Again the entropies defined over 
the second MSM are rather similar to those of the 
whole image. 

The two-variable mutual informations are rather 
small, which is expected because of the decorrela- 
tion achieved by this system. Contrary to the RGB 
system, now Iiap < 0, which yields an increase of 
the mutual information between two variables when 
the third is known. Let us emphasize that on the 
pixels common to the three MSM's the value of Iiafi 
is still more negative: this implies that on this set 
the degree of dependence of the gradients is larger 
than over the whole image. Given that in this sys- 
tem the three two- variable mutual informations are 
rather close, the argument applies to the three pos- 
sible pairs. 



VII. CONCLUSIONS 

In this work we have studied the statistical properties 
of spatial changes of the chromatic channels in two dif- 
ferent chromatic systems: the cone responses RGB and 
the decorrelated version of these, la(3 [^. The main con- 
clusion is that natural color images exhibit multiscaling 
effects similar to monochromatic images |^Jl^, for both 
chromatic systems. In particular, it has been checked 
that the multiscaling statistical properties are very well 
described in the context of multiplicative processess, with 
just two free parameters. 

An explicit decomposition of the images in their frac- 
tal components was also done using a wavelet technique. 
The most important of these components (that we have 
called the Most Singular Manifold, MSM), is given by 
the obvious contours in each chromatic channel. It was 
found that the RGB and the Za/3 systems have rather 
different geometrical structure. While the first exhibits 
a great deal of redundancy, in the sense that the frac- 
tal components of the three channels are quite similar, 
the decorrelated system extracts different features in the 
different channels. 

In addition to this, this fractal structure helps to de- 
tect the most informative pixels in the images. To study 
this issue we have computed several information quanti- 
ties: the total entropy, the mutual information between 
pairs of channels, and the information shared by the three 
channels of a given system. This analysis reveals that the 
MSM contains the most informative pixels in the image, 
for the six considered channels. There are differences be- 
tween the RGB and the la(3 systems. All the measured 
quantities show that the first is highly redundant, in that 
a given channel contains a large amount of information 
about the others. On the contrary, the decorrelated sys- 
tem has eliminated some redundancy. However, there is 
still a substantial amount mutual information, which is 
maximal over the MSM. 

We want to emphasize that the multiscaling properties 
discussed here give an a priori information about what 
a natural image is, reducing the entropy of the ensemble 
of natural scenes. This could be useful for explaining the 
processing of color images in the early stages of the visual 
pathway. The existence of such a rich structure suggests 
that the second order statistics alone do not contain all 
visually significant information, and that higher order 
centers of visual processing may be present in biological 
system. 
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Information in the RGB system 





Hr 


Ha 


Hb 


Igb 


Irb 


Irg 


Krgb 


Irgb 


Whole Image 


4.77 


4.78 


4.13 


0.94 


0.90 


2.76 


3.76 


0.84 


Foo 


5.35 


5.34 


4.69 


1.30 


1.25 


3.22 


4.64 


1.13 


Fh, 


4.92 


4.93 


4.73 


0.86 


0.81 


2.78 


3.72 


0.73 



TABLE I. Entropies and mutual informations in the RGB system, arranged in columns. The first three columns represent 
the entropies of the Red, Green and Blue variables. The next three columns represent the mutual information between the 
different pairs. The last two columns represents the two definions we have given for the mutual information of the three 
variables altogether. The rows refer to the spatial extent of the sampling: the whole image (top) , the intersection of the three 
MSM's (middle) and the intersection of the three first manifolds (bottom); here, hi — —0.3 ±0.1. All the data is expressed in 
bits. The bit depth of |VC|(x) for each component was taken to be 8 bits, what means that it has been discretized in 2 = 256 
values; thus the maximal possible value of each entropy is 8. 



Information in the lap system 





Hi 


H^ 


H0 


he 


Iw 


IcH 


Klafi 


hal3 


Whole Image 


6.45 


5.84 


5.25 


0.15 


0.13 


0.10 


0.67 


-0.29 


Fo. 


6.48 


6.04 


5.60 


0.29 


0.24 


0.19 


1.71 


-0.99 


Fh^ 


6.44 


5.85 


5.22 


0.19 


0.15 


0.13 


0.97 


-0.50 



TABLE II. Entropies and mutual informations for the lajS system, arranged in columns. The first three columns represent 
the entropies for the I, a and (3 variables, and the following are arranged as those of Table |. The rows refer to the same 
geometrical sets as in Table Q. All the data is expressed in bits. The bit depth for each component was taken to be 8 bits. 
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FIG. 1. Verification of ESS for tlie tfiird and fourtfi order moments of the liorizontal EC in tfie RGB chromatic system 
(Diamonds:Red, crosses: Green, boxes: Blue). Tlie best linear fits are also represented. Each data point corresponds to a fixed 
value of r, from 4 to 64 pixels. Although not shown here, the vertical EC gives an equally good fit. 
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FIG. 2. Verification of ESS for the third and fourth order moments of the horizontal EC in the la/3 system. (Diamonds: I, 
crosses: a, boxes: /3). The best linear fits are also represented. It is observed that the /3 component (boxes) deviates significantly 
from the others, probably because this component lacks numerical accuracy (it is given by the difi'erence between the color 
channels with the nearest wavelengths). Each data point corresponds to a fixed value of r, from 4 to 64 pixels. Although not 
shown here, the vertical EC gives an equally good fit. 
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FIG. 3. ESS coefficients p{j>, 2) for the RGB (left) and the /q:/3 (right) chromatic systems, and the horizontal EC (Symbols 

as in Figures nl and 0) . The comparison with the Log-Poisson model prediction (as described in Section Ww is also represented 

for each component. RGB system: /3_r — 0.45, Pa = 0.45 and /3s — 0.46; lap system: Pi — 0.50, Pa ~ 0.50 and Pp — 0.73 
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FIG. 4. Experimental distributions (diamonds) of Ina^L for a) the horizontal Red EC and b) the horizontal I EC; r — 4 
pixels, L = 64 pixels. Both distributions are far from Gaussian, but very close to a Poisson distribution with the appropriate pa- 
rameters (crosses). The average number of transitions (/3-modulations) for both processes is the same: s = (d — D^) In — = 2.77. 
This number is rather small to yield a Gaussian behaviour 











FIG. 5. Gray level representations of the RGB system (top) and the associated MSM's (bottom) on Park2 image. The 
MSM's were taken as the sets of points having exponent h — —0.5 ± 0.1. The Blue component has significantly less contrast 
than the others, which makes it difficult or even impossible to detect some of its edges. The MSM's of all members in the RGB 
system are however very similar. 




FIG. 6. Gray level representations of the laf3 system (top) and the associated MSM's (bottom) of the Park2 image. The 
MSM's were taken as the sets of points having exponent h — —0.5 ±0.1. The l3 component appears rather saturated. Although 
the most important transitions are present in the three chromatic variables, there is a significant amount of structure detected 
by only one of the three, reducing the geometrical redundancy. 



